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PIPELINE ACCELERATOR FOR IMPROVED COMPUTING ARCHITECTURE 
AND RELATED SYSTEM AND METHOD 

Claim of priority 

[1] This application cfaims priority to U.S. Provisiona! Appfication Seriai 

5 No> 60/422,503, fiied on October 31 , 2002, which Is incorporated by reference. 

Cross reference to related apf»ucations 

[2] This appfication 'm related to U.S. Patent App, Serial Nos, 10/684,102 

entitled IMPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, 10/684.053 entitled COMPUTING IVIACHiNE HAVING iyPROVED 

1 0 COMPUTING ARCHITECTURE AND RELATED SYSTEM AND y ETHOD. 

10/684,057 entitled PROGRAMMABLE CiRCUfT AND RELATED COMPUTING 
MACHINE AND METHOD, and 10/683,932 entitled PIPELINE ACCELERATOR 
HAVING MULTiPLE PIPELINE UNITS AND RELATED COMPUTING MACHINE 
AND METHOD, all filed on October 9, 2003, and having a common owner, and 

15 which are mcorporated by reference, 

BACKGROUND 

PI A common computing architecture for processing reiatively large 

amounts of data \n a relatively short period of tinne Includes multiple interconnected 
processors that share the processing burden. By sharing the processing burden, 
20 these multipfe processors can often process the data more quickly than a single 

processor can for a given dock frequency. For example, each of the processors can 
process a respective portion of the data or execute a respective portion of a 
processing algorithm. 

[4] FIG. 1 is a schematic biock diagram of a conventiona! computing 

25 machine 10 having a muitHprocessor architecture. The machme 16 includes a 
master processor 12 and coprocessors 14i - f 4^, which a>mmunicate with each 
other and the master processor via a bus 16, an input port IB for receiving raw data 
from a remote device (not shown In FIG. 1), and an output port 20 for providing 
processed data to the remote source. The machine 10 also includes a memory 22 
30 for the master processor 12, respecbVe memories 24i - 24^ for the coprocessors 14i 
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— f4«t and a memory 26 that the master prooassor and coprocessors share via the 
bus 16. The memory 22 serves as both a program and a working memory for the 
master processor 12, and each memory 24^ - 24fi serves as both a program and a 
working memory for a respective coprocessor 14i - 14^. The shared memory 26 
5 allows the master processor 12 and the coprocessors 14 to transfer data among 
themselves, end from/to the remote device via the ports f S and 20, respeGtSvely. 
The master processor 12 and the coprocessors 14 also receive a common clock 
signal that controls the speed at which the machine 10 processes the raw data. 

[5] In general, the computing machine 10 effectively divides the 

1 0 processing of raw data among the master processor 12 and the coprocessors 14. 
The remote source {not shown in FIG. 1) such as a sonar array toads the raw data 
via the port 18 into a section of the shared memory 26, which acts as a 
first-in-flrst«DUt (FIFO) buffer (not shown) for the raw data. The master processor 12 
^ retrieves the raw data from the memory 26 via the bus 1Q, and then the master 
15 processor and the CDprocessors f4 process the raw data, transferring data among 
themseives as nBcessary via the bus 16. The master processor 12 loads the 
processed data into another FjFO buffer (not shown) defined in the shared memory 
26, and the remote source retrieves the processed data from this FIFO via the port 
20. 

20 [6| in an example of operation , the computing machine 10 processes the 

raw data by sequentially performing n ^ 1 respective operations on the raw data, 
where these operations together compose a processing algorithm such as a Fast 
Fourier Transfonn (FFT). More specificaliy, the machine 10 fonns a data-processing 
pipeline from the master processor 12 and the coprocessors 14. For a given 

25 frequency of the clock signal, such a pipeline often allows the machine 10 to process 
the raw data faster than a machine having only a single processor. 

I?! After retrieving the raw data from the raw-data FIFO (not shown) in the 

memory 26, the master processor 12 performs a first operation, such as a 
trigonometric function, on the raw data. This operation yields a first result, which the 
30 processor 12 stores m a first-resuit FIFO (not shown) defined within the memory 26. 
Typically, the processor 12 executes a program stored in the memory 22, and 
performs the abova-described actions under the contml of the program. The 
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processor 12 may also use the memory 22 as working memory to tamporarily store 
data that the processor generates at intermediate intervals of the first operation, 

[8] Next, after retrieving the first result from the first-result FIFO (not 

shown) In the memory 26, the coprocessor 14i performs a second operation, such 
5 as a logarithmic function » on the first result This second operation yieids a second 
result, which the coprocessor 14i stores in a second-result FIFO {not shown) defined 
within the memory 26. Typically, the coprocessor 14i executes a program stored in 
the memory 24t. and performs the above-described actions m^ier the control of the 
program. The coprocessor 14i may aiso use the memory 24i as working memory to 
10 temporarily store data that the coprocessor generates at intermediate intervals of the 
second operation. 

[9| Then, the coprocessors 24^ - 24^ sequantiafly perfomn third - 

operations on the second - (n-lf ' results in a manner similar to that discussed 
above for the coprocessor 24i. 

15 [10] The operation, which is perfomied by the coprocessor 24„, yields 

the final result, Lb., the processed data. The coprocessor 24n loads the processed 
data into a processed-data FIFO {not shown) defined within the memory 26, and the 
remote device (not shown in FIG, 1) retrieves the processed data from this FIFO. 

Because the master processor 12 and coprocessors 14 are 
20 simuitaneously performing different operations of the processing algorithm, the 

computing machine 10 is often able to process the raw data faster than a computing 
machine having a single processor that sequenttaily performs the different 
operations. Specillcai!y, the single processor cannot retrieve a new set of the raw 
data until it performs all n ^ 1 operations on the previous set of raw data. But using 
25 the pipeline technique discussed above, the master processor 12 can retrieve a new 
set of raw data after peiforming only the first operation. Consequently, for a given 
dock frequency, this pipeline technique can increase the speed at which the 
machine 10 processes the raw data by a factor of approximately n 1 as compared 
to a single-pHDicessor machine (not shown in FIG* 1). 

30 [12] Alternatively, the computing machine 10 may process the raw data in 

parallel by Simyltaneously performing n + 1 instances of a processing aigorithm, 
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such as an FFT, on the raw data. That is, jf the aigorithm includes n + 1 sequential 
operations as dascribad above in tha previous example, then each of the master 
processor 12 and the coprocessors 14 sequentially perform all n ^ 1 operations on 
respective sets of the raw data. Consequentiy, for a given clock frequency, this 
5 paraSiel-pmoessing technique, tike the above-described pipeline technique, can 
increase the speed at which the machine 10 processes the raw data by a factor of 
approxlmatety n ^ 1 as compared to a singte-processor machine (not shown in FIG- 
1). 

[13| Unfortunately, although the computing machine 10 can process data 

10 more quickly than a singie-processor computer machine (not shown in FIG, 1 ), the 
data-processing speed of the machine 10 is often signrficantiy iess than the 
frequency of the processor clock. Spedficafly, the data-processing speed of the 
computing machine 10 is limited by the time that the master processor 12 and 
coprocessors 14 require to process data. For brevity, an example of this speed 

15 fimitation is discussed m conjunction wfth tha master processor f 2, afthough it is 
understood that this discyssion also appfies to the coprocessors 14. As discussed 
above, the master processor 12 executes a program that controls the processor to 
manipulate data In a desired manner. This program mcludes a sequence of 
instructions that the processor 12 executes. Unfortunately, the processor 12 

20 typically requires myltipfe ciock cydes to execute a singie instruction, and often must 
execute muiiple instructions to process a single value of data. For exampie, 
suppose that the processor 12 is to multipiy a first data value A (not shown) by a 
second data value B (not shown). During a first oiock cycle, the processor 12 
retrieves a multiply Instruction from ftie memory 22, During second and third clock 

25 cycles, the processor 12 respectively retrieves A and 8 from the memory 26. During 
a fourth ciock cycle, the processor 12 muiliplies A and B, and, during a fifth clock 
cycte, stores the resulting product in the memory 22 or 26 or provides the resulting 
product to the remote device (not shown). This is a best*case scenario, because in 
many cases the processor 12 requires additional clock cycles for overhead tasks 

30 such as initraiizing and cfosing counters. Therefore, at best the processor 12 
requires five ciock cycles, or an average of 2.5 ciock cycles per data value, to 
process A and B,. 
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[143 Consequently, the speed at which the computing machine 10 

processes data Is often significanfly lower than the frequency of the clock that drives 
the master processor 12 and the coprocessotrs 14. For example, if the processor 12 
is clocked at 1.0 Gigahe«tz (GHz) but requires an average of 2.5 clock cycles per 
data value, then the effective data-processing speed equals (1 .0 GH2)/2.5 = 0.4 
GHz. This effective data-processing speed is often characterized in units of 
operations per second. Therefore, in this example, for a clock speed of 1.0 GHz, the 
processor 12 would be rated with a data-processing speed of 0.4 
Gigaoperattons/second (Gops), 

E1S] FIG. 2 Is a block diagram of a hardwired data pipeline 30 that can 

typically process data faster tiian a processor can for a given clodc frequency, and 
often at substantially the same rate at which the pipeline is clocked. The pipeline 30 
includes operator drcuits 32f - 32o, which each perform a respective operation on 
respective data without executing program instructons. That is, the desired 
operation is "burned In" to a circuit 32 such that it implements the operation 
automatically, without the need of program instructions. By eliminating the overhead 
associated with executing program instructions, the pipeline 30 can typically peribrm 
more operations per second than a processor can for a given clock frequency, 

[1 63 For example, the pipeline 30 can often solve the following equation 

faster than a processor can for a given dock frequency; 

Y(Xic) = (5xf, + 3)2'* 

where Xk represents a sequence of raw data values. In this example, tfie operator 
circuit 32i is a multiplier that calculates 5xk, the circuit 322 is an adder that calculates 
5xj£ + 3, and the circuit 32a {n - 3) is a multiplier that calculates {5Xh + 3)2^''-. 

It 73 During a first dock cyde k=1 , the circuit 32i receives data value Xi and 

multiplies it by 5 to generate 5xi. 

El 8} During a second clock cycle k 2, the circuit 322 receives 5xi from the 

circuit 32i and adds 3 to generate 5xi + 3. Also, during the second clock cycle, the 
circuit 32i generates 5x2. 

During a third clock cyde k 3. the circuit 323 receives 6xi + 3 from 
the cimurt 322 and multiplies by 2''''(effective!y left shifts 5xi + 3 by xi) to generate 

5 
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the first result (5xi ^ 3)2^ \ Also during the third dock cycle, the circuit 32f generates 
5x3 and the ctrcuit 322 generates 5xs ^ 3. 

pOj The pipeiine 30 continues processmg subsequent raw data values in 

this manner until ali the raw data values are processed* 

5 [21] Consequentiy, a delay of two dock cycles after receiving a raw data 

value xi — this delay is often called the latency of the pipeline 30 — the pipeline 
generates the result (5xi 3)2'^\ and thereafter generates one resutt — e.g., (5X2 + 
3)2"^^, (5X3 3)2'^, , . 5xn ^ 3)2''" — each dock cycle, 

[22] Disregarding the latency, the pipeline 30 thus has a data-processing 

10 speed equal to the clock speed. In comparison, assuming that the master processor 
12 and coprocessors 14 {FIG. 1) have data-processing speeds that are 0.4 times the 
dock speed as in the above example, the pipeline 30 can process data 2.5 times 
faster than the computing machine 10 (FIG. 1) for a given clock speed. 

|23| Still referring to FIG. 2, a designer may choose to implement the 

15 pipeline 30 in a programmable logic IC (PLIC), sudi as a field-programmable gate 
array (FPGA), because a PLIC allows more design and modification fle>dbility than 

does an application specific IC (ASiC). To configure the hardwired connections 
within a PLIC, the designer merely sets Interconnection-configuration nsgisters 
disposed within the PLIC to predetermined binary states. The combination of all 

20 these binary states is often cailed 'firmware/* Typlcaily, the designer loads thSs 

firmware into a nonvofatite memory (not shown in FIG. 2) that is coupled to the PLIC, 
When one "turns on" the PLIC, it downloads the firmware from the memory into the 
interconnectfon-configuration registers. Therefore, to modify the functioning of the 
PLIC, the designer merely modifies the firmware and allows the PLIC to download 

25 the modified firmware into the interconnection-^configu ration registers. This ability to 
modify the PLfC by menely modfiying the firmware Is particularly useful during the 
prototyping stage and for upgrading the pipeline 30 In the field", 

[24] Unfortunately, the hardwired pipeline 30 may not be the best choice to 

execute algorithms that entail significant decision making, particularly nested 
30 decision making. A processor can typicaily execute a nested-dedsion-making 

instrudion {e.g., a nested conditional instnjdion such as "if A, then do B, else if C, 
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do D, . . . , else do ) approximately as fast as it can execute an operational 
Instruction (e.g., -'A + 8*') of comparabte length. But although the pipeline 30 may be 

able to make a relatively simple decision (e.g., "A > B?") eificlently, it typicaily cannot 
executo a nested decision {e.g., "if A, then do B, else if C, do D, . , else do n") as 
5 efficiently as a processor can. One reason for this inefficiency is that the pipeline 30 
may have iittie on-board memory, and thus may need to access external 
working/instruction fnemor>/ (not shown). And although one may be able to design 
the pipeline 30 to execute such a nested decision, the size and complexity of the 
required circuitry often makes such a design Impractrcai, particularly where an 
10 algorithm includes multiple different nested decisions, 

[251 Consequently, processors are typically used in applications that 

require significant decision making, and hardwired pipelines are typically limited to 
"number crunching" applications that entail little or no decision making. 

[26] Furthermore, as discussed beiow, it is typicaliy much easier for one to 

15 design/modify a processor-based computing machine, such as the computing 
machine 10 of FIG. 1, than it is to design/modify a hardwired pipeline such as the 
pipeline 30 of FIG. 2, parttcularly where the pipeline 30 includes multtpie PLICs. 

1271 Computing components, such as processors and their peripherals 

{e,g,, memory), typically Include industry-standard communication Interfaces that 
20 facilitete the interconnection of the components to form a processor-based 
computing machine, 

. [28] Typically, a standard communication interface includes two layers: a 

physical layer and a services layer, 

[29] The physical layer includes the circuitry and the corresponding circuit 

25 interconnections that form the interface and the operating parameters of this 
circuitry* For example, the physical layer includes the pirn that connect the 
component to a bus, the buffers that latch data received from the pins, and the 
drivers that drive signals onto the pins. The operating parameters Include the 
acceptable voltage range of the data signals that the pins receive, the signal timing 
30 for writing and reading data, and the sypported modes of operation {e.g., burst 
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mode, page mode). Conventional physica! layers Include transistoNransistor logic 
(TTL) and RAMBUS. 

[30] The services layer includes the protocoi by which a computing 

component transfers data. The protoco! defines the format of the data and the 
5 manner in which the component sends and receives the formatted data. 

Conventionaf communication protocois include file-transfer pmtoco! (FTP) and 
transmission contro! protocol/internet protocof (TCP/IP). 

[31] Consequently, because manufacturers and others typically design 

computing components having industry-standard commynicatfon interfaces, one can 

10 typicaHy design the interface of such a component and interconnect it to other 

oomputing components with relativeiy IMe effort. This ailowa one to devote most of 
his time to designing the other portions of the oomputing machine, and to easily 
modify the machine by adding or removing components, 

|32| Designing a computing component that supports an industry-standard 

15 communication jntarface allows one to save design time by using an existing 

physicaWayer design from a design library. This also insures that he/she can easily 
interface the component to off-the-shelf computing components. 

I33| And designing a computing machine using computing components that 

support a common industry-standard communication interfece allows the designer to 

20 interconnect the components with iittle time and effort. Because the components 
support a common interface, the designer can interconnect them via a system bus 
with little design effort. And because the supported interface is an industry standard, 
one can easily modify the machine. For exampfe. one can add different components 
and peripherals to the machine as the system design evolves, or can easily 

25 add/design next-generation o^mponents as the technology evolves. Furthermore, 
because the components support a common industry-standard service layer, one 
can incorporate into the computing machine's software an existing software module 
that implements the corresponding protocol. Therefore, one can interface the 
components with iittle effort because the interfeoe design is essentially already In 

30 place, and thus can focus on designing the portions (e.g., software) of the machine 
that cause the machine to perform the desired Itinction(s), 

8 
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E34J But ynfortynateiy, there are no known industry-standard sen/ices 

layers for components, such as PLICs, used to form hardwired pipelines such as 
the pipeline 30 of FIG* 2. 

[35] Consequently, to design a pipeline having multiple PLICs, one typicaHy 

5 spends a significant amount of time and exerts a significant effort designing and 
debugging the services iayerof the communication interface between the PLICs 
*trom scratch." TypicaHy, such an ad hoc services iayer depends on the parameters 
of the data being transferred between the PUCs. Likewise, to design a pipeline that 
interfaces to a processor, one would have to spend a significant amount of time and 
10 exert a significant effort in designing and debugging the services layer of the 
communication interface between the pipeline and the processor from scratch* 

|363 Similarly, to modify such a pIpeEina by adding a PLIC to it, one typicaliy 

spends a sSgnificant amount of time and exerts a significant effort designing and 
debugging the services layer of the communication interface between the added 
15 PLIC and the existing PLiCs. Likewise, to modify a pipeline by adding a processor, 
or to modify a computing machine by adding a plpeiina, one would have to spend a 
significant amount of time and exert a significant effort in designing and debugging 
the services layer of the communicatton interface between the pipeline and 
processor, 

20 137} Consequently, referring to FIGS. 1 and 2, because of the difficulties in 

interfacing multiple PLICs and in interfaci ng a procassorto a pipeiine, one is often 
forced to make significant tradeoffs when designing a computing machine. For 
exampia, with a processor-based computing machine, one is fbnt)ed to tr^da 
number-crunching speed and design/modification flexibility for complex decision« 

25 making ability. Conversety, with a hardwired pipeline-based computing machine, 
one is forced to trade comptex-declsion-making ability and design/mod if Scatioo 
iaxibiiity for number-crunching speed. Furthermore, because of the difficuities in 
interfacing multipie PLICs, it Is often impractical for one to design a pipeline-based 
machine having more than a few PLICs. As a result, a practicai pipeline-based 

30 machine often has limited functionaiity. And because of the difficulties in interfacing 
a processor to a PLIC, it would be impractical to interface a processor to more than 



wo 2004/042562 



CA 02503617 2005-04-25 



one PLIC. As a result the benefits obtained by combining a processor and a 
pipeiine would be minimaL 

[38] Therefore, a need has arisen for a new compyting architecture that 

allows one to combine the decisbn-making ability of a processor-based machine 
5 with the number-crunching speed of a handwired-pipeline-based machine. 

Summary 

|39] According to an embodiment of the invention, a pipeline acceferator 

Includes a memory and a hardwired-pipeline circuit coupled to the memory. The 
hardwirad-pipeHne circuit is operable to reoeiva data, load the data into the memory, 
10 retrieve the data from the memory, process the retrieved data, and provide the 
processed data to an external source, 

[403 According to another embodiment of the invention, the 

hardwired-pipeline circuit is operable to receive data, process the received data, 
load the processed data into the memory, retrieve the processed data from the 
15 memory » and provide the retrieved processed data to an external source, 

{41] Where the pipeline accBieretDr is coupled to a processor as part of a 

peer-vector machine, the memoty facilitates the transfer of data — whether 
unidirectionai or bidirectional — between the hardwired-pipeMne circuit and an 
application that the processor executes. 

20 BmEF Descriptioh of the Drav^ings 

[42] FIG. 1 is a block diagram of a computing machine having a 

conventional multi-processor architecture, 

[433 2 is a block diagram of a conventional hardwired pipeline. 

1443 FIG* 3 is a biock diagram of a computing machine having a pear-vector 

26 architecture aocording to an embodiment of the invention. 

£433 4 is a block diagram of the pipeiine accelerator of FIG. 3 

according to an embodiment of the invention, 

[46] FIG. 5 is a bfock diagram of the hardwired-pipeiine circuit and the data 

memory of FIG* 4 according to an embodiment of the invention. 

10 
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[471 PIG^ 6 is a block dtagm m of the memory-write interfaces of the 

communication shaf! of FIG. 5 according to an embodiment of the invention, 

[48| FIG. 7 is a block diagram of the memory-read interfaces of the 

communication she!! of FIG. 5 according to an embodiment of the invention. 

5 149] FIG. 8 IS a block diagram of the pipeline accelerator of FIG. 3 

according to aniother embodiment of the Invention, 

[50] FIG. 9 is a block diagram of the hardwired-pipeiine drcuit and the data 

memory of FIG. 8 according to an embodiment of the invention. 

Detailed Descrjptjon 

10 [513 FIG. 3 Is a schematic block diagram of a computing machine 40, which 

has a peer-vector architecture according to an embodiment of the Invention, in 
addition to a host processor 42, the peer-vector machine 40 Includes a pipafine 
accelerator 44, which perfomis at least a portion of the data processing, and v^hich 
thus 0ffeotive!y raplaoas the bank of coprocessors 14 in the computing machine 10 

15 of FIG, 1 . Therefore, the host-processor 42 and the acceferator 44 (or units thereof 
as discussed below) are "peers" that can transfer data vectors back and forth. 
Because the acceferator 44 does not execute program instructions, it typicaiiy 
performs mathematically intensive operations on data significantly faster than a bank 
of coprocessors can for a given ciock frequency. Consequently, by combining the 

20 decision-making ability of the processor 42 and the number-crunching ability of the 
acceferator 44, the machine 40 has the same abilities as, but can often process data 
faster than, a conventional computing machine such as the machine 10. 
Furthermore, as discussed below, providing the accelerator 44 with a 
communication interface that is compatibie with the communication interface of the 

25 host processor 42 facliftates the design and modification of the machine 40, 

particularly where the processor's communication interface Is an indusfry standard. 
And where the accelenator 44 includes multiple pipeiine units (e.g., PLIC-based 
circuits), pnwiding each of these units with the same communication interface 
facilitates the design and modification of the accelerator, particuiarly where the 

30 commynicatton interfaces are compatible with an industry-standard interface. 
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Moreover, the machine 40 may also provide other advantages as described below 
and in the previoysty cited patent applications. 

[S23 Sm referring to FIG, 3, in addition to the host processor 42 and the 

pipeiine accelerator 44, the peer-vector computing machine 40 indudes a processor 
6 memory 46, an interface memory 48, a bus 50, a firmware memory 52, an optional 
raw-data input port 54, a processed<lata output port 58, and an optionai router $1. 

[53J The host processor 42 indudes a processing unit 62 and a message 

handler 64, and the processor memory 46 includes a processing-unit memory 66 
and a handler memory 68, which respectivety serve as both program and working 
10 memories for the processor unit and the message handler. The processor memory 
46 also includes an accelerator-Gonfigu ration registiy 70 and a 
massaga-configy ration registry 72, which store respective configuration data that 
aliow the host processor 42 to configure the functionSng of the accelerator 44 and the 
format of the messages that the message handler 64 sends and receives. 

16 [543 The pipeline accelerator 44 is disposed on at least one PLJC (not 

shown) and inciudes hanjwired pipelines 74i - 74„, which process respective data 
Without executing pfogram {nstructions. The firmware memory 52 stores the 
configuration firmware for the accelerator 44> If the accelerator 44 is disposed on 
multiple PLlCs, these PLtCs and their respective firmware memories may be 

20 disposed in multiple pipeline units (FIG* 4), The accelerator 44 and pipeline units 
are discussed further befovv and in previously cited U.S, Patent App. Seria! No. 
10/683,932 entitled PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE 
UNITS AND RELATED COMPUTING yACHINE AND METHOD. Altarnatively, the 
accelerator 44 may be disposed on at least one ASiC, and thus may have internai 

25 interconnections that are unconflgurable. In this alternative, the machine 40 may 
omit the firmware memoty 52. Furthermore, although the accelarator 44 is shown 
including multiple pipelines 7^, it may inciude onSy a single pipeiine. In addition, 
eithough not shown, the accelerator 44 may include one or more processors such as 
a digital-signal processor (DSP)- Moreover, aithough not shown, the accelerator 44 

30 may Indude a data input port and/or a data output port. 

|553 The genera! operation of the peer-vector machine 40 is discussed in 

previously cited VS. Patent App. Serial No. 10/684,102 entitled IMPROVED 
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COMPUTING ARCHITECTURE AND RELATED SYSTEM AND METHOD, and the 
structure and operation of the pipeiln© acceferatcH' 44 is discussed below In 
conjunction with FIGS. 4-9. 

t563 FIG. 4 IS a scfiematic block diagram of the pipeline accelerator 44 of 

FIG. 3 according to an embodiment of the invention. 

{STi The accelerator 44 includes one or more pipeline units 7B, each of 

which Includes a pipeline circuit SO, such as a PLIC or an ASIC. As discussed 
ftirther below and in previously cited U.S. Patent App, Serial No, 10/683,932 entitled 
PIPELINE ACCELERATOR HAVING MULTIPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD, each pipeiine unit 78 is a "peer" of the host 
processor 42 and of the other pipeiine units of the accelerator 44. That is, each 
pipeline unit 7B can communicate directiy with the host processor 42 or with any 
other pipeline unit. Thus, this peer-vector architecture prevents data "bottlenecks" 
that otherwise might occur if all of the pipeline units 78 communicated through a 
central location such as a master pipeline unit (not shown) or the host processor 42. 
Furthermore, it aliows one to add or remove peers from the peer-vector machine 40 
(FIG. 3) without significant modifications to the machine. 

f58| Tlie pipeline circuit BO includes a communication Interface 82, whic^i 

transfers data between a peer, such as the host processor 42 (FIG, 3), and the 
following other component of the pipeline ctrcutt: the hanjwired pipelines 74^74/, 
(FIG. 3) via a communication shelf 84, a controller 86, an exception manager 88, 
and a configuration manager 90. The pipeiine circuit 80 may also Include an 
industry-standard bus interface 01, Aiternatively, the functionality of the Interface 01 
may be included within the communication interface 82. 

J59] By designing the components of the pipeline circuit 80 as separate 

modules, one can often slmp% the design of the pipeline circuit That Is, one can 
design and test each of these componente separately, and Uien Integrate them 
much like one does when designing software or a processor-based computing 
system (such as the system 10 of FIG. 1 ). in addition, one can save in a library (not 
shown) han^ware descnptlon language (HDL) that defines these components — 
parHcularly components, sudi as the communication interface 82, that wll! pnabably 
be used frequently in other pipeline designs — thus reducing the design and test 

13 
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time of future pipeline designs that use the same components. That is, by using the 
HDL from the !ibrarj?% the designer need not redesign previously implemented 
components 'trom scratch", and thus can focus his efforts on the design of 
components that were not previously implemented, or on the modffioation of 
5 previously implemented components. Moreover, one can save in the ilbrary HDL 
that defines multiple versions of the pipeline circuit SO or of the entire pipeiine 
acceterator 44, so that one can pick and choose among existing designs. 

[60] The communication interface 82 sends and receives data tn a fomnat 

recognized by the message handler 64 (FIG. 3), and thus typically faciiitates the 

1 0 design and modification of the peer-vector machine 40 (FIG* 3), For example, i the 
data format is an industry standard such as the Rapid I/O format then one need not 
design a custom interface between the host processor 42 and the accelerator 44. 
Furthermore, by allov^/ing the pipefine circuit 80 to communicate with other peers, 
such as the host processor 42 (FIG, 3), via the pipeline bus 50 instead of via a 

15 non-bus interface, one can change the number of pipeline units 78 by merefy 

connecting or disconnecting them (or the circuit cards that hoid them) to the pipeline 
bus histead of redesigning a non-bus interface from scratch each time a pipeline unit 
is added or removed, 

[613 '^^^ hardwired pipelines 74i-74n perform respective operations on data 

20 as discussed above in conjunction with FIG« 3 and in previously cited U.S. Paieni 
App. Seria! No, 10/684,102 entftled IMPROVED COMPUTING ARCHITECTURE 
AND RELATED SYSTEM AND METHOD, and the communication shell 84 
interfaces the pipeiines to the other components of the pipeline circuit 80 and to 
circuits (such as a data memory 02 discussed below) externa! to the pipeline circuit, 

25 [62] The controller 06 synchronizes the hardwired pipelines 74iJ4n and 

monitors and contross the sequence in which they perform the respective data 
operations in response to communications, Ib., "events/' from other peers. For 
example, a peer such as the host processor 42 may send an event to the pipeline 
unit 78 via the pipeline bus 50 to indicate that the peer has finished sending a block 

30 of data to the pipeline unit and to cause the hardwired pipeiines 74iJ4n to begin 
processing this data. An event that includes data is typicaffy called a message, and 
an event that does not include data is typically catted a "^door bell.'' Furthermore, as 
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discussed below in conjuncljon with FIG. 5, the pipeline unit 78 may also 

synchronize the pipelines 74iJ4n in response to a synchronization signal 

[63] The exception manager 88 monitors the status of the hardwired 

pipelines 74i-74n, the communication interface 82, the communication she)! 84, the 
5 controlfer 86, and the bus interface 01, and reports excepttons to the host processor 
42 {FIG, 3). For example, if a buffer In liie communication interface B2 overflows, 
then the exception manager 88 reports this to the host processor 42. The exception 
manager may also correct, or attempt to correct, the problem givtng rise to the 
exception. For example, for an overflowing buffer, the exception manager 88 may 
1 0 increase the size of the buffer, either directly or via the configuration manager 90 as 
discussed below, 

[64] The configuration manager 90 sets the soft oonfigu ration of the 

hardwired pipelines 74i-74a. the communication interface 82, the communication 
shell 84, the controller 86, the exception manager 88, and the interface 9tin 

1 5 response to soft-configuration data from the host processor 42 {FIG. 3) — as 
discussed in previously cited U.S. Patent App, Semi No, 10/684,102 entitled 
llViPROVED COMPUTING ARCHITECTURE AND RELATED SYSTEM AND 
METHOD, the hard configuration denotes the actual topoiogy, on the transistor and 
circult-biock level, of the pipefina circuit SO, and the soft configuration denotes the 

20 physical parameters (e.g., data width, tabie size) of the hard-configured 

components. That is, soft configuration data is similar to the data that can be loaded 
Into a register of a processor (not shown in FIG* 4) to set the operating mode {ag., 
burst-memory mode) of the processor. For exampie, the host processor 42 may 
send soft-configuration data that causes the configuration manager 90 to set the 

25 number and respectjva priority levels of queues in the communication interface 82. 
The exception manager 88 may also send soft-configuration data that causes the 
configuration manager 00 to, e.g., Increase the size of an overflowing buffer m the 
communication interface 82, 

[65J Still referring to FIG, 4, in addition to the pipeiine circuit SO, the pipeiine 

30 unit 78 of the accelerator 44 includes the data memory 92, an optional 

communication bus 94, and, if the pipeline circuit is a PLIC, the finnware memory 52 
(FIG. 3)- 
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[66| The data memory 92 buffers data as It flows between another peer, 

such as the host processor 42 (FIG. 3), and the hardwired pIpeOnes 74r74n, end is 
also a working memory for the hardwired pipelinea The commynteation Interface 82 
interfaces the data memory 92 to the pipeline bus SO (via the communloatton bus 94 
and industry-standard interface 91 if present), and the communrcation she!! 84 
interfaces the data memory to the hardwired pipeiines 74r74n* 

[67] The industry-standard interface 91 is a conventbnai bus-mterface 

circuit that reduces the size and complexity of the communication interface B2 by 
effectively offloading some of the Interface circuitry from the communication 
interface. Therefore, if one wishes to change the parameters of the pipeline bus 50 
or router 61 (FIG* 3), ttien he need only modify the interface 91 and not the 
communication interface B2. Alternativeiy, one may dispose the interface 91 m an 
IC (not shown) that is external to the pipeline drcyft 80. Offloading the interface 91 
from the pipeline circuit 80 frees up resources on the pipeline circuit for use in, e.g., 
the hardwired pipalines 74i-74,, and the controliar 8G. Or, as discyssed above, the 
bus interface 91 may be part of the communication interface 82. 

[68] As discussed above in conjunction with FIG. 3, where the pipeline 

Circuit 80 is a PL!C, the firmware memory 52 stores the firmware that sets the hard 
configuration of the pipeline circuit The memory 52 ioads the firmware Into the 
pipeiine circuit 80 during the configuration of the accelerator 44, and may receive 
modified firmware from the host processor 42 (FIG. 3) via the communication 
interface 82 during or after the configuration of the acceierator The loading and 
receiving of firmware is further discussed in previously cited U.S. Patent App. Serial 
No. 10/684,057 entitled PROGRAMIVIABLE CIRCUIT AND RELATED COMPUTING 
IVIACHiNE AND METHOD. 

[69] Still referring to FIG. 4, the pipayne circuit SO, data memory 92, and 

firmware memory 52 may be disposed on a circuit board or card 98, which may be 
plugged into a pipeline-bus connector (not shown) much lii<a a daughter card can be 
plugged Into a slot of a mother board in a personal computer (not shown). Although 
not shown, conventional ICs and components such as a power regulator and a 
power sequencer may also be disposed on the card SSas is known. 
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[701 Further detaHs of ttie strucUire and operation of the pipeline unit 78 are 

discussed below in conjunction wfth FIG. 5, 

[71] FJG. 5 is a block diagram of the pipeline unit 78 of FIG. 4 according to 

an embodiment of the Invention. For clanty, the firmware memory 52 is omitted from 
FIG, 5. The pipeline circuit 80 receives a master CLOCK signal, which drives the 
below-described components of the pipeline circuit either directly or indlrecfly. The 
pipeline circuit SO nriay generalB one or more slave dock signals (not shown) from 
the master CLOCK signal in a conventional manner The pipeline circuit 80 may 
also a receive a synchronizafion signal SYNC as discussed below. 

[72] The data memory 92 includes an input duai-port-static-random-access 

memory (DPSRAM) iOO, an output DPSRAM f 02, and an optional worf^ing 
DPSRAM i04. 

[73] The input DPSRAM 100 includes an Input port 106 for receiving data 

from a peer, such as the host processor 42 {FIG . 3), via the communication interface 
82, and Includes an output port f 08 for providing this data to the hardwired pipelines 
74i'74„ via the communication sheil 84. Having two ports, one for data input and 
one for data output, increases the speed and efficiency of data transfer to/from the 
DPSRAM 100 because the communication interface 82 can write data to ttie 
DPSRAM while the pipelines 74i-74n read data from the DPSRAM. Furthermore, as 
discussed above, using the DPSRAM fOO to buffer data from a peer such as the 
host processor 42 allows the peer and the pipelines 74i-74n to operate 
asynchronously relative to one and other. That Is, the peer can send data to the 
pipelines r4f-74„ without halting" forth© pipelines to complete a current operation. 
Likewise, the pipeftnes 74r74„ can retrieve data without "waiting" for the peer to 
complete a data-sending operation. 

|74] Similarly, the output DPSRAM 102 includes an Input port 110 for 

receiving data from the hard\A^red pipelines 74f74n via the communication shell 84, 
and Includes an output port 112 for providing this data to a peer, such as the host 
processor 42 (FIG. 3), via the communication interface 82. As discussed above, the 
two data ports 110 (Input) and 112 (output) increase the speed and efficiency of data 
transfer to/from the DPSRAM ?02, and using the DPSRAM 102 to buffer data from 
the pipelines 74r74a allows the peer and the pipelines to operate asynchronously 
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relative to one another That is, the pipelines 74r74n can publish data to the pear 
wStfioyt %vaiting" for the output-data handler 12BiQ complete a data transfer to the 
peer or to another peer> Likewise, the output-data handler 12B can transfer data to a 
peer without "waiting'' for the pipeiines 74r74n to compfete a data-publishing 
operation, 

[7S3 The working DPSRAM 104 includes an input port 114 for reGeiving 

data from the hardwired pipelines 74i-74n via the communication shell 84, and 
includes an output port ff fi for returning this data back to the pipeiines via the 
communication sheL White processing input data received from the DPSRAM f 00, 
the pipelines 74i-74n may need to temporarily store partially processed, Le., 
intermediate, data before continuing the processing of this data. For example, a first 
pipeline, such as the pipeline 74f, may generate intermediate data for further 
processing by a second pipeline, such as the pipeline 74^: thus, the first pipeline 
may need to temporarily store the intermediate data until the second pipeline 
retrieves it. The working DPSRAM 104 provides this temporary storage. As 
disGussed above, the two data ports 114 (input) and 116 (output) increase the speed 
and efficiency of data transfer between the pipelines 74r 74n and the DPSRAM i04. 
Furthermore, Including a separate working DPS RAM f 04 typicaify increases the 
speed and efficiency of the pipeline circuit SO by afiowing the DPSRAfWs 100 and 
102 to function exclysivety as data-input and data-output buffem, respectively. But, 
with slight modification to the pipeline circuit 80, either or both of the DPSRAMS 100 
and 102 can also be a working memory for the pipelines 74r74n when the DPSRAM 
104 is omitted, and even when it is present 

[76] Although the DPSRAMS f 00, f 02. and ir04 are described as being 

externaf to the pipeline circuit SO, one or more of these DPSRAy S, or equivalents 
thereto, may be Internaj to the pipeline circuji 

[77] Stil! referring to FIG. 5, the commynication interface 82 includes an 

industry-standard bus adapter f f«, an input-data handler 120, input-data and 
input-event queues f 22 and f 24, an output-data handler f 26, and output-data and 
output-event queues 120 and 1Z0. Afthough the queues 122, 124, 128, and f 30 are 
shovi^n as single queues, one or more of these queues may include sub queues (not 
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shown) that aliow segregation by, e.g., priority, of the values stored in the queues or 
of the respBotive data that these vaiyes represent. 

[78] The industry-standard bus adapter HB includes the physical layer that 

allows the transfer of data between the pipeline circuit 80 and the pipeline bus 50 
(FIG. 4) via the communication bus 94. Therefore, if one wishes to change the 
parameters of the bus 94, then he need only modify the adapter f fSand not the 
entire oommuntcation interface 82. Where the industiy-standard bus interface 91 is 
omitted from the pipeline unit 7S, , then the adapter 118 may be modified to aitow 
the transfer of data directly between the pipeline bus SO and the pJpeiine circuit 80, 
in this latter implementation, the modified adapter 118 includes the functionality of 
the bus interface 91, and one need only modify the adapter 118 if he/she wishes to 
change the parameters of the bus 50. 

179} The input-data handier 120 receives data from the industry-standani 

adapter 118, loads the data into the DPSRAM 100 via the input port 106, and 
generates and stores a pointer to the data and a corresponding data identifier in the 
Input-data queue 122. if the data is the payload of a message from a peer, such as 
the host processor 42 {FIG- 3), then the input-data handier 120 extracts the data 
from the message before loading the data into the DPSRAM 100. The input-data 
handler 120 includes an Interface 132, which writes ttie data to the input port f 06 of 
the DPSRAM 100 and which is further discussed below in conjunction with FIG- 6. 
Attemafively, the input-data handler f 20 can omit the extraction step and load the 
entire message into the DPSRAM 100, 

{80| The input-data handler 120 also receives events from the 

industry-standard bus adapter 118, and toads the events into the input-event 
queue 124. 

[813 Furthermore, the input-data handier 120 inciudes a validation 

manager 134, whbh determines whether received data or events are hitended for 
the pipeline circuit 80. The vaHdation manager f 34 may make this determination by 
analyzing the header (or a portion thereof) of the message that contains the data or 
the event, by analyzing the type of data or event, or the analyzing the instance 
identification {/.a., the hardwired pipelme 74 for which the data/evont is intended) of 
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the data or event ff the input-data handier 120 receives data or an event that is not 
intended for the pipeline circuit 80, then the vaOdation manager 134 prohibits the 
input-data handler from loading the received data/even. Where the peer-vector 
machine 40 inclydes the router 81 (FIG, 3) such that the pipeline unit 7S should 
5 receive only data/eveots that are intended for the pipeline unit, the validation 
manager 134 may ateo cause the input-data handler 120 to send to the host 
processor 42 (flG. 3) an exception message that identifies the exception 
(erroneously received data/event) and the peer that caused the exception. 

[82] The output-data handler f 26 retrieves processed data from locations of 

10 the DPSRAM 102 pointed to by the output-data queue 128, and sends the 

processed data to one or more peers, such as the host processor 42 (FIG. 3), via 
the industry-standard bus adapter 118. The output-data handler 126 includes an 
interfaoe f 36, which reads the processed data from the DPSRAM f 02 via the port 
112. The Interface 136 is further discussed below in conjunction with FIG. 7, 

15 C83| The outpyt-data handler f 20 also retrieves from the output-event 

queue f 30 events generated by the pipelines 74f - 74„, and sends the retrieved 
events to one or more peers, such as the host processor 42 (FIG. 3) via the 
industry-standard bus adapter 118. 

IB4} Furthermore, the output-<lata handler 126 includes a subscription 

20 manager 138, which includes a list of peers, such as the host processor 42 {FIG, 3), 
that subscribe to the processed data and to the events; the output-data handier uses 
this list to send the data/events to the correct peers. If a peer prefers the data/event 
to be the payioad of a message, then the output-data handier 126 retrieves the 
network or bus-port address of the peer from the subscription manager 138, 
25 generates a header that inciudes the address, and generates the message from the 
data/event and the header* 

IBS] Although the technique for storing and retrieving data stored in the 

DPSRAMS 100 and 102 involves the use of pointers and date jdentifiers, one may 
modify the input- and output-data handlers f 20 and f 26 to impfement other 
30 data-management techniques. Conventional examples of such data-management 
techniques Include pointers using keys or tokens, input/output control (iOC) block, 
and spooling. 
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[86] The communication shell 84 incfudes a physical layer that interfaces 

the hardwired pipelines 74i-74a to flie output-data queue 12$, the controiier 86, and 
the DPSRAlVis 100, 102, and 104. The sheli S4 inciudes interfaces f 40 and 142, 
and optional interfaces 144 and f 46. The interfaces 140 and 14$ may be similar to 
the interface f 36; the interface 140 reads input data from the DPSRAM 100 via the 
port 10$, and the interface 146 reads intermediate data from the DPSRAM 104 via 
the port 116. The interfaces 142 and 144 may be similar to the interface 152; the 
interface 142 writes processed data to the DPSRAM 102 via the port 110, and the 
Interface 144 writes intermediate data to the DPSRAM 104 via the port 114. 

[87] The contix^ier ^ Indudes a sequence manager 148 and a 

synohronizaSon interface f 50, which receives one or more synchronizatton signals 
SYNC. A peer, such as the host processor 42 (FIG. 3), or a device (not shown) 
external to the peer-vector machine 40 (FIG. 3) may generate the SYNC signal, 
which triggers the sequence manager 148 io activate the hardwired pipelines 74r 
74„ as discussed beiow and in previously cited U.S, Patent App. Serial No. 
10/683,932 entitled PIPELINE ACCELERATOR HAViNG IV3ULT1PLE PIPELINE 
UNITS AND RELATED COMPUTIMG MACHINE AND METHOD, Tlie 
synchronizatson interface ISO may also generate a SYNC signal to trigger the 
pipeline circuit 80 or to trigger another peer. In addition, the events from the 
input-event queue 124 also trigger the sequence manager 148 to activate the 
hardwired pipelines 74t'74n as discussed below. 

IBSl The sequence manager 148 sequences the hardwired pipelines 74^ 

74tt through their respective operations via the communication shell 84, Typically, 
each pipeline 74 has at least three operating states: preprocessing, processing, and 
post processing. During preprocessing, the pipeline 74, e.g., initializes Its registers 
and retrieves input data from tfie DPSRAM 100, During processing, the pipeline 74, 
e.g., operates on the retrieved data, temporarily stores intermediate data tn the 
DPSRAM 104, retrieves the Intermediate data from the DPSRAM 104, and operates 
on the Intermediate data to generate result data. During post processing, the 
pipeline 74, e.g„ loads the result data into the DPSRAM 102. Therefore, the 
sequence manager 148 monitors the operation of the pipelines 74i-74„ and instructs 
each pipeline when to begin each of its operating states. And one may distribute the 
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pipeilne tasks among the operating states differently than described above. For 
example, the pipeline 74 may retrieve input data from the DPSRAM 100 during the 
processing state instead of during the preprocessing state, 

[89j Furthermore, the sequence manager 148 maintains a predetermined 

mterna! operating synchronization among the hardwired pipelines 74i-74n> For 
example, to avoid ail of the pipelines 74^74^ simuitaneously retrieving data from the 
DPSRAM 100, it may be desired to synchronize the pipelines such that while the first 
pipeline 74i is in a preprocessing state, the second plpefrne 74^ is in a pnDcessing 
state and the ttiird prpaiine 74s is in a post-processing state. Because a state of one 
pipeline 74 may require a different number of dock cycles than a concurrentiy 
performed state of another pipeline, the pipelines 74^-74^ may lose synchronization if 
allowed to run freely. Consequently, at certain times there may be a ''bottle neck," 
as, for example, muftiple pipelines 74 simultaneousiy attempt to retrieve data from 
the DPSRAM 100, To prevent the loss of synchronization and its yndesirabje 
consequences, the sequence manager 148 allows ali of the pipelines 74 to compiete 
a current operating state before allowing any of the pipelines to pnDceed to a next 
operating state. Therefora, the time that the sequence manager f 45 allots for a 
current operating state is long enough to allow the slowest pipeline 74 to complete 
that state. Alternatively, circuitry (not shown) for maintaining a predetermined 
operating synchronization among the hardwired pipelines 74r74j^ may be included 
within the pipelines themselves. 

[903 In addition to sequencing and internaily synchronizing the hardwired 

pipelines 74^* 74n, the sequence manager f 43 synchronizes the operation of the 
pipelines to the operation of other peers, such as the host processor 42 (FIG. 3), and 
to the operation of other external devices in response to one or more SYNC signals 
or to an event in the input-events queue 124. 

|91] Typically, a SYNC signal triggers a time-critical function but requires 

significant hardware resources; comparativaly, an event typically triggers a 
non-time-critical function but requires significantly fewer hardware resources. As 
discussed in previousfy cited U,S, Patent App. Serial No- 10/683,932 entifled 
PiPELINE ACCELERATOR HAVING MULTiPLE PIPELINE UNITS AND RELATED 
COMPUTING MACHINE AND METHOD, because a SYNC signal is rauted direct!y 
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from peer to peer, it can trigger a function more quickly than an event, which must 
makes its way through, e.g., the pipefine bus SO (FIG. 3), the input-data handier 120, 
and the input-event queue 124. But because they are separately routed, the SYNC 
signals require dedicated circuitry, such as routing fines, buffers, and the SYNC 
interface 150, of the pipeline circuit 80. Conversely, because they use the existing 
data4ransfer infrastaictyre (e.g: the pipeHne bus 50 and the Input-data handler 120), 
the events require only the dedicated input-event queue 124. Consequently, 
designers tend to use events to trigger af{ but the most time-oritica! functions. 

|92] The following is an example of ftjnction triggering. Assume that a 

sonar sensor efement (not shown) sends Mocks of data to the pjpeHne unft 78, the 
input-data handler 120 stores this data in the DPSRAM 100, the pipeline 74i 
transfers this data from the DPSRAM 100 to the DPSRAM 104, and, when triggered, 
the pipeline 742 retrieves and processes the data from the DPSRAM 104. tf the 
processing that the pipeline 74^ performs on the data is time criticaf, then the sensor 
element may generate a SYNC pulse to trigger the plpeifne 742> via the interface 150 
and the sequence manager 148, as soon as the pipeline 74i finishes loading an 
entire block of data into the DPSRAM 104. There are many conventional techniques 
that the pipeline unit 78 and the sensor can employ to determine when the pipeline 
74i is finished. For exampfe, as discussed betow, the sequence manager 148 may 
provide a corresponding SYNC pulse or event to the sensor Afternatively, if the 
processing that the pipeline 742 performs is not time criticaf, then the sensor may 
send an event to the sequence manager 148 via the pipeline bus SO (FIG, 3). 

[93| The sequence manager 148 may also provide to a peer, such as the 

host processor 42 (FIG, 3), information reganSIng the operation of the hardwired 
pipelines 74i-74n by generating a SYNC pulse or an event* The sequence manager 
148 sends a SYNC puJse via the SYNC interface f 50 and a dedicated line (not 
shown), and sends an event via the output-event queue 1W and the output-data 
handler f 26, Referring to the above exampie, suppose that a peer further processes 
the data blocks from the pipeline 742^ The sequence manager 148 may notify the 
peer via a SYNC puise or an event when the pipeline 742 has finished processing a 
block of date> The sequence manager f 45 may also confirm receipt of a SYNC 
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pulse or an event by generating and sending a cotresponding SYNC pulse or event 

to the appropriate p©er(s). 

[941 StiH referring to FIG. 5, the operation of the pipeline unit 78 is 

disofssed accortling to an embodiment of the invention. 

[95] For date, ihe industry-standard bus interface 91 receives data signals 

(which onginates from a peer, such as the host processor 42 of FIO. 3) from the 
pipeline bus 50 {and the router 61 rf present), and translates these s^nals Into 
messages each having a header and paj^oad. 

[96] Next, the industry-standard bus adapter 118 converts the messages 

from the industry-standard bus interface 91 into a format that Is compatibJe with the 
input-data handler 120, 

197} Then, the Input-data handier fa? dissects the message headers and 

extracts from each header the portion that describes the data payload. For example, 
the extracted header portion may inciude, e.g., the address of the pipeline unit 78, 
the type of data in the payload, or an Instance identifier that Identifies the pipe!ine(s) 
78i - 78n for which the data is intended. 

[983 Next, the validation manager f 34 analyzes the extracted header 

portion and confirms that the data is intended for one of the hardwired pipelines 74r 
74„, the interface 152 writes the data to a location of the DPSf=^AM f 00 via the port 
f 06, and the input-data handier 120 stores a pointer to tfie locatic^i and a 
con-esponding data identifier in the input-data queue 122. The data identifier 
Identifies the pipeline or pipelines 74i~74„ for which the data is intended, or includes 
infonnatlon that allows the sequence manager f45to make this identlficalion as 
discussed below. Attematlveiy, ttte queue 122 may include a respective subqueue 
(not shown) for each pipeline 74i-74„, and the Input-data handier 120 stores the 
pointer In the subqueue or subqueues of the intended pipeline or pipelines. In this 
alternative, the data Identifier may be omitted. Furthermore, if the data is the 
payload of a message, then the input-data handler 120 extracts the data from the 
message before the interface 132 stores the data in the DPSiRAM f 00. 
Alternatively, as discussed above, the interface 132 may store the entire message in 
the DPSRAM 100, 
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[993 Then, at the appropriate time, the sequence manager 148 reads the 

pointer and the data identifier from the Input-data queue 122, determines from the 
data identifier the pipeline or pipelines 74, - 74„ for which the data is intended, and 
passes the pointer 1o the pipeiine or pipelines via the communication shell 84. 

[100| Next, the data-receiving pipeline or pipelines 74i - 74„ cause the 

interface 140 to retrieve the data from the pointed-to iocation of the DPSRAiW1 100 
via tfie port 108. 

noij Then, the data-receiving pipeline or pipelines 74i-74„ process the 

retrieved data, tie interface f 42 writes the processed data to a iocation of the 
DPSRAM 102 via the port 110, and the communication shell $4 toads into the 
output-data queue 128 a pointer to and a data identifier for the processed data. The 
data identifier identifies the destination peer or peers, such as the host processor 42 
(FIG. 3), that subscribe to the processed data, or inciudes information (such as the 
data type) that allows the subscription manager 1S8 to subsequently determine the 
destination peer or peers (e.g., the host processor 42 of FIG, 3). Aiternativeiy, the 
queue 128 may Include a respective subqueue (not shown) for each pipeline 74f 
74n, and the communication shell 84 stores the pointer in the subqumJe or 
subqueues of the originating pipeline or pipelines. In this alternative, the 
communication shell 84 may omit loading a data identifier Into the queue 128. 
Furthermore, if the pipeline or pipelines 74r74„ generate intermediate data while 
processing the retrieved data, then the interface f44 writes the intermediate data 
into the DPSRAM 104 via the port 114, and the Interface 148 retrieves the 
Intemiediate data from the DPSRAM 104 via the port 118, 

1102] Next, the output-data handler 126 retrieves the pointer and the data 

identifier from the output-data queue 128, the subscription manager 138 determines 
from the identifier the destination peer or peers (e.g., the host processor 42 of Fi<3, 
3) of the data, the interface 136 retrieves the data from the pointed-to location of the 
DPSRAM 192 via the port 112, and the output-data handler sends the data to the 
industry-standard bus adapter 118. If a destination peer requires the data to be the 
payload of s message, then the output-data handier 126 generates the message 
and sends the message to the adapter 118, For example, suppose the data has 
multiple destination peers and the pipeline bus $0 supports message broadcasting. 
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The output-data handier 126 generates a single header that includes the addresses 
of a!! the destination peers, combines the header and data into a message, end 
sends {via the adapter 118 and the industry-standard bus interface 91) a single 
message to all of the destinatton peers simultaneousiy. Alternatively, the output- 
5 data handier 126 generates a respective header, and thus a raspective message, for 
each destination pear, and sands each of the messages separately, 

[1031 Then, the industry-standard bus adapter 118 fonnats the data from the 

outputKJata handler f 26 so that it is compatible with the industry-standard bus 
interface 91. 

10 [104] Next, the industry-standafd bus interface 91 formats the data from the 

industry-standard bus adapter 118 so that it Is compatibie with the pipeline bus SO 
(FIG. 3). 

[105| For an event with no accompanying data. Lb., a doorbetl, the 

industry-standard bus interface 91 receives a signal {which originates fram a peer, 
1 5 sut^ as the host processor 42 of FIG. 3) from the pipetine bus 50 (and the router 61 
if present), and translates the signa! into a header (Lb., a data-less message) that 
includes the event. 

[106| Next, the indystry-standard bus adapter 118 converts the header from 

the industry-standard bus interface 91 into a format that is compatible with the 
20 input^data handler 120, 

[107] Then, the Input-data handier 120 extracts from the header the event 

and a description of the event. For example, the description may include, e.g., the 
address of the pipeline unit 78, the type of event, or an instance identifier that 
identifies the pipejine(s) 78i - 78n for which the event is intended* 

26 [108] Next, the validation manager 134 analyzes the event description and 

confirms that the event is intended for one of the hardwired pipelfnes 74r 74ns and 
the input-data handler f 20 stores the event and Its description in the input-event 
queue 124. 

limi Then, at the appropriate time, the sequence manager 148 reads the 

30 event and Its description from the input-event queue f 24, and, in response to the 
event, triggers the operation of one or more of the pipelines 74r74n as discussed 
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above* For example, the sequence manager 148 may trigger the pipeline 742 to 
begin processing data that the pipeline 74i previously stored in the DPSRAM 104. 

[1 101 To output an event, the sequence manager 148 generates the event 

and a description of the event, and loads the event and its description into the 
5 output-event queue 130 — the event description identifies the destination peer(s) for 
the event if there is more than one possible destination peer. For example, as 
discussed above, the event may confirm the receipt and impiementation of an input 
event, an input-data or input-event message, or a SYNC pulse 

[1111 Next, the output-data handler 12$ retrieves the event and its 

10 description from the output-event queue ISO, the subscription manager 138 

determines itom the event descriptjon the destination peer or peers (e,g,, the host 
processor 42 of FIG. 3) of the event, and the output-data handler sands the event to 
the proper destination peer or peers via the industry-standard bus adapter 118 and 
the industry-standard bus Interface 91 as discussed above. 

15 |;i12| For a configuration command, the industry-standard bus adapter 118 

receives the command from the host pn^cessor 42 (FIG- 3) via the industry-standard 
bus interface 9t, and provides the command to the input-data handler 120 in a 
manner similar to that discussed above for a data-4ess event (Lb., doorbell) 

[11 3] Next, the validation manager f 34 confirms that the command is 

20 intended for the pipeline unit 78, and the input-data handler 120 toads the command 
into the configuration manager 90. Furthermore, either the input-data handler 120 or 
the configuration manager 90 may also pass the command to the output-data 
handfer f 20, which confirms that the pipeline unit 78 received the command by 
sending the command back to the peer (e.g., the host processor 42 of FIG, 3) that 
25 sent the command. This confirmation technique is sometimes called "echoing," 

[1143 Then, the configuration manager 90 implements the command. For 

example, the command may cause the configuration manager 90 to disable one of 
the pipelines 74r74n for debugging pyrposes. Or, the command may alSow a peer, 
such as the host processor 42 (FIG, 3), to read the current configuration of the 
30 pipeline circuit 80 from the configuration manager 90 via the output-data handier 
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f 26, In addition, one may use a configyration command to define an exception that 
is recognteed by the exception manager 88. 

[115| For an exception, a component, such as the input-data queue 122, of 

the pipeline circuit 80 triggers an exception to the exception manager 88. in one 
implementation, the component Inctudes an exceptfon-triggering adapter (not 
shown) that monitors the component and triggers the exception in response to a 
predetermined condition or set of conditions. The exception4riggering adapter may 
be a universal circurt that can be designed once and then mcluded as part of each 
component of the pipeline circuit 80 that generates exceptions, 

[11 6] Next, in response to the exceptton trigger, the exception manager BB 

generates an exception rdentifien For exampie, the identifter may indicate that the 
input-^iata queue 122 has overflowed. Furthermore, the identifier may include its 
destination peer if there is more than one possibie destinatton peer, 

[117] Then, the output-data handier 126 retrieves the exception identifier 

from the exception manager 88 and sends the exception identifier to the host 
processor 42 (FIG. 3) as discussed In previously cited U.S. Patent App. Sena! No- 
10/684,053 entitled COMPUTiNG MACHINE HAVING IMPROVED COMPUTING 
ARCHiTECTURE AND RELATED SYSTEM AND METHOD. Alternatlveiy, If there 
are multipie possible destination peers, then the exception identifier can also Include 
destination infomnation from which the subscription manager f38 determines the 
destination peer or peers (e.g. , the host processor 42 of F!G. 3) of the identifier. The 
output-data handler f 26 then sends the Identifier to the destination peer or peers via 
the industry-standard bus adapter 118 and the industry-'Standard bus interface 91. 

{1 1 8] Stiil referring to FIG. 5, afternative embodiments to the pipeline unit 78 

exist- For example, although described as including DPSRAMs, the data memory 
92 may include other types of memory ICs such as quad*data-rate (QDR) SRAMs, 

11193 FIG. 6 is a block diagram of the interface 142 of FIG, 5 according to an 

embodiment of the invention. As discussed above in conjynction with FIG, 5, the 
interface f 42 writes processed data from the hardwired pipelines 74i-74n to the 
DPSRAM 102. As discussed below, the structure of the interface 142 reduces or 
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eliminates data "bottlenecks" and, where the pipeHne circuit 80 {FIG. 5) Is a PLIC, 
makes efficient use of the PLtC's local and globai routing resoyrces. 

[120] The interface 142 indudes write channels 150t - f 50„, one channel for 

each hardwired pipeline 74i - 74^ (FIG. 5), and inciudes a Gontrofler 152. For 
purposes of Iflystratbn, the channel ISOi is discussed below, it being understood 
that the operation and structure of the other channels ISO2 - 150^ are stmilar unless 
stated otherwise, 

[1211 The channef ISOi Includes a wnte-address/data FIFO 154i and a 

address/data register 156f. 

[122] The FIFO 154^ stores the data that the pipeline 74i writes to the 

DPSRAM 102, and stores the address of the location within the DPSRAM f 02 to 
which the pipeline writes the data, until the controller 152 can actually write the data 
to the DPSRAM 102 via the register ISSf. Therefore, the FIFO 154i reduces or 
eliminates the data bottleneck that may occur if the pipailne 74^ had to '*waft" to write 
data to the channel ISOi until the contnoller f52 finished writing previous data. 

[1231 The FIFO f 54# receives the data from the pipeline 74i ma a bus ISSi, 

receives the address of the iocation to which the data is to be written via a bus f 60f, 
and provides the data and address to the register 156i via busses 162^ and 164i, 
respectivefy. Furthermore, the FIFO 154i receives a WRITE FiFO sigoai from the 
pipeline 74i on a line 166i, receives a CLOCK signal via a line f 6Sf, and provides a 
FIFO FULL signal to the pipeline 74i on a line 170^. fn addition, the FIFO 1S4i 
receives a READ FIFO signal from the controller f 52 via a fine f 72f, and provides a 
FIFO EMPTY signal to the oontroiler via a line 174i. Where the pipeline circuit 80 
{FIG. 5) Is a PLiC, the busses f 58f, f 60^, Wti, and 104i and the lines t66f, f SSf, 
170i^ 172i, and 174^ are preferably formed using local routing resources. Typically, 
local routing resources are preferred to global routing resources because the signal- 
path lengths are generally shorter and the routing is easier to Implement, 

[124] The register 1S9i receives the data to be written and the address of 

the write location from the FIFO 154i via the busses 162i and 164i, respectively, 
and provides the data and address to the port ItO of the DPSRAM 102 (FIG. 5) via 
an address/data bus 17Q. Furthermore, the register 156? also receives the data and 
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address from the registers ISBs- 156„ \na an address/data bus 178i as discussed 
below, in addition, the register 1S$i receives a SHfFT/LOAD signal from the 
controller 152 Via a line 180. Where the pipeline circuit SO (F!G. 5) is a PLIC, the 
bus 176 is typically formed using gfobaf routing resources, and the busses 178i ~ 
178n-i and the line f SO are preferably formed using local rauting resources. 

[125| In addition to receiving the FIFO EMPTY signal and generating the 

READ FIFO and SHIFT/LOAD signals, the controller 152 provides a WRITE 
DPSRAM signal to the port 110 of the DPSRAM 102 (FrG. 5) via a line 182, 

[126] StlH referring to FIG, 6, the operation of the interface 142 is discussed. 

1127] First, the FIFO 154i drives the FIFO FULL signal to the iogic level 

corresponding to the orrrent state ("full" or "not full") of the FIFO. 

[128| Next, If the FIFO 154i Is not full and the pipefine V4f has processed 

data to wit©, the pipeline drives the data and corresponding address onto ihe 
busses 158i and f 60t. respectively, and asserts the WRITE signal, thus loading the 
data and address into the FIFO. If the FIFO f 54f is fuil, however, the pipeline 74i 
waits until the FIFO is not full before loading the data. 

[1 293 Then, the FIFO 154i drives the FIFO EMPTY signal to the logic level 

corresponding to the current state f empty" or "not empty") of the FIFO, 

El 30| Next, If the FIFO 154i is not empty, the controller 1S2 asserts the 

READ FIFO signal and drives the SHIFT/LOAD signal to the load logic level, thus 
loading the first loaded data and address firom the FIFO Into the register 156i. If the 
FIFO 194i is empty, the controller 152 does not assert READ FIFO, but does drive 
SHIFT load to the ioad iogic level if any of the other FIFOs 1S4r154n are not empty. 

[1 31 3 The channels f 5<?2 - 1SQ„ operate in a similar manner such that firet- 

ioaded data in the FIFOs 1542 ~ 154„ are respectively loaded into the 
registers iSS^JBSn, 

£1 323 Then, the controller 152 drives the SHIFT/LOAD signal to the shift logic 

lev©} and asserts the WRITE DPSRAM signal, thus serially shifting the data and 
addresses from the registers 156i - 156^ onto *ie address/data bus 176 and loading 
the data into the corresponding locations of the DPSRAM 102. Specificaily, during a 
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first shift cycte, the data and address from the register 15$i are shifted onto the bus 
176 such that the data from the FIFO 154^ is foaded into the addressed location of 
the DPSRAy 102. Also during the first shift cycle, the data and address from the 
register f 56a are shifted into the register 156i, the data and address from the 
5 register I563 (not shown) are shifted into the register 1562, and so on. During a 
second shift cyde, the data and address from the register 156^ are shifted onto the 
bus 17$ such that the data from the FIFO 1542 loaded into the addressed iocation 
of the DPS RAM 102, Also during the second shift cycie, the data and address from 
the register IS62 are shifted into the register f 56f, the data and address from the 

10 register 1503 (not shown) are shifted into the register ISGzr and so on. There are n 
shift cycles, and during the nth shift cycle the data and address from the regjster 
156n (which is the data and address from the FIFO 1S4a) is shifted onto ttie bus 176. 
The controfier 152 may implement these shift cycles by pulsing the SHIFT/LOAD 
signal, or by generating a shift clock signal {not shown) that is coupled to the 

1 5 registers 156i-15$n^ Furthermore, if one of the registers 1S6i- 156^ is empty during a 
particular shift operation because its corresponding FIFO 154^-1S4ttwa^ empty 
when the controlier f 52 loaded the register, then the controller may bypass the 
empty register, and thus shorten the shift operation by avoiding shifting nuH data and 
a nuti address onto the bus 176. 

20 [1 33] Referring to FIGS. 5 and 6, according to an ambodtment of the 

invention, the fnterface 144 is similar to the interface 142, and the interface 132 is 
also similar to the interface 142 except that the interface 132 includes only one write 
channe! f SO, 

[1 34] FIG. 7 is a block diagram of the interface 140 of FIG. S according to an 

25 embodiment of the invention. As discussed above in conjunction with FIG. 5, the 
inteiface 140 reads input data from the DPSRAM 100 and transfers this data to the 
hardwired 74^-74^^ As discussed below, the structure of the interface 140 reduces 
or eyminates data "bottienecks^^ and, where the pipeline circuit 80 (FIG. 5) is a PLiC, 
makes efficient use of the PLIC's iocal and global routing resources. 

30 11353 The interface 140 includes read channels fSOf - f one channel for 

each hardwired pipeline 74f - 74^ (FfG. 5), and a controller f 92. For purposes of 
lilustration, the read channel 190i is discussed below, it being understood that the 
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op^atlon and structure of the otiier read channels 1^2 - 190„ are similar uniess 
stated otherwise. 

£136] The channel 190i includes a FIFO 104i and an address/identifier (iD) 

register 1Q6i. As discussed below, the identifier identifies the pipeline 74i-74a that 
makes the request to read data from a particular location of the DPSR/UVl iOO to 
receive the data. 

[137J The FIFO i94i indudes two sub-FIFOs {not shown), one for storing the 

address of the location wthin Itie DPSRAM 100 fron^ w^lch the pipeline 74i wishes 
to read the input data, and the other for storing the data read from the DPSRAM 
10Q. Therefore, the FIFO 1Mi reduces or eliminates the bott{enecl<: that may occur 
if the pipeline 74i had to "waif to provide the read address to the channe! 19Qi until 
the controlier 192 finished reading previous data, or if the controller had to wait until 
the pipeline 74i retneved the read data before the controlier could read subsequent 
data. 

[138] The FIFO f 94* receives tiie read address from th© pipeline 74i \da a 

bus 19Bi and provides the address and fO to the register f 96f via a bus 2<W?. Since 
the ID corresponds to the pipeline 74i and typically does not change, the FIFO 194i 
may store the ID and concatenate the iD with the address. Alternatively, the pipeline 
74i may provide the ID to the FIFO 194i >na the bus f9Sf. Furthermore, the FIFO 
194i receives a READY WRITE FIFO signal from the pipeline 74i via a line 202i, 
receives a CLOCK signal via a line 204i, and provides a FIFO FULL (of read 
addresses) signal to the pipeline via a Sine 206^, In addition, the FIFO 194i receives 
a WRITE/READ FIFO signal from the controlier 192 via a line 20Si, and provides a 
FIFO EMPTY signal to the controller via a line 2f Of. Moreover, the FiFO 194i 
receives the read data and the corresponding ID from the controlier 192 via a bus 
212. and provides this data to the pipeline 74f via a bus 214i. Where th© pipeline 
circuit 80 (FIG. 5) is a PLIC, the busses 198i, 200i, and 214i and the lines 202i, 
204i, 2001, 20Si, and 2f 0f are preferably formed using local rauting resources, and 
tie bus 212 Is typically formed using global routing resources. 

[1393 The register 196i receives the address of the location to be read and 

the corresponding iD from the FIFO 194i via the bus 206i, provides the address to 
the port fOaof the DPSRAM 100 (FIG. 5) via an address bus 216, and provides the 
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ID to the oontroHer 192 via a bus 218. Furthermore, the register 196i also receives 
the addresses and IDs from the registers IdSz- 196n via an address/ID bus 220i as 
dlscusssd below. In addition, the register f 96j receives a SHIFT/LOAD signai from 
the controller 192 via a Une 222. Where the pipeline circuit 80 (FIG. 5) is a PLIC, the 

bus 216 is typically formed using giobal routing resources, and the busses 
220i^20„.i and the line 222 are preferably formed using local routing resources. 

|;140| In addition to receiving the FIFO EMPTY signal, generating the 

WRITE/READ FIFO and SHIFT/LOAD signals, and providing the read data and 
corresponding ID, the controller 192 receives the data read from the port 108 of the 
DPSRAM 100 (FIG. 5) via a bus 224 and generates a READ DPSRAM signal on a 
line 22$, which couples this signal to the port 108. Where the pipeline circuit 80 
(Fl<3. 5) Is a PtIC, the bus 224 and the line 226 are typically formed using giobal 
routing resources. 

i141J Stii! referring to FIG. 7. the operation of the Interface 140 is discussed. 

[1421 First, the FIFO 194i dnves the FIFO FULL signal to the logic level 

con-esponding to the cun-ent state ("fuH" or "not full") of the FIFO relative to the read 
addresses. That Is, If the FIFO 194i is full of addresses to be read, then it drives the 
logic level of FIFO FULL to one level, and if the FIFO is not full of read addresses. It 
drives the logic level of FIFO FULL to another level. 

[143] Next, if the FIFO 194i is not full of read addresses and the pipeline 74^ 

is ready for more input data to process, the pipeline drives the address of the data to 
be read onto the bus W8i, and asserts the READ/WRITE FIFO signal to a write 
level, thus loading the address into the FIFO. As discussed above In conjunction 
with FIG. 5, the pipeline 74? gets the address from the input-data queue t22 via the 
sequence manager 148. If, however, the FiFO 194i is full of read addresses, the 
pipeline 74i waits until the FIFO is not full before loading the read address. 

|144| Then, the FIFO 194i drives the FIFO EMPTY signal to the logic level 

corresponding to the current state ("empty" or "not empty") of the FiFO relative to the 
read addresses. That Is. If the FIFO 194i is loaded with at least one read address, it 
drives the logic level of FIFO EMPTY to one level, and if the FiFO is loaded with no 
read addresses. It drives the logic level of FIFO ElVIPTY to another level. 
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[145] Next, If the FIFO 194i is not empty, the controller 192 asserts the 

WRITE/READ FIFO signaf to the read logic leva! and drives the SHi FT/LOAD signaf 
to the load logic ieve}> thus loading the first foaded address and the fD from the FIFO 
into the register 196i. 

1146] The channels 190z - 190n operate in a mmilar manner such that the 

conlroHer 192 respectfveiy foads the first-ioaded addresses and IDs from the 
FfFOs 1942 - 194n into the registers 196^ - f9«ff- If aii of the FIFOs 194^-194^^ are 
empty, then the controlier f 92 waits for at least one of the FIFOs to receive an 
address before proceeding. 

[1473 Than, the controller 192 drives the SHIFT/LOAD signal to the shift logic 

ieve! and asserts the READ DPSRAM signaf to serially shift the addresses and IDs 
from the registers f 96f - f 96^? onto the address and ID busses 216 and 218 and to 
serially read the data from the corresponding locations of the DPSRAM 100 via the 
bus 224. 

|148| Next, the controfier f 02 drives the received data and corresponding ID 

— the ID allows each of the FIFOs 194i - 194n to determine whether it Is an 
intended redpient of the data — onto the bus 212, and drives the WRITE/READ 
FiFO signal to a write level, thus serially writing the data to the respective FIFO, 
194i-194n^ 

{149] Than, the hardwired pipelines 74r74n sequentially assert their 

READ/WRITE FIFO signals to a read level and sequentially read the data via the 
busses 214i-214it. 

i;i 50| still refening to FiG* 7, a more detailed discussion of their data-read 

operator is presented, 

[151] During a first shift cycle, the controifer 192 shifts the address and ID 

from the register ?9Sf onto the busses 216 and 21B, nespectively, asserts read 
DPSRAM, and thus reads the data from the corresponding location of the DPSRAM 
100 via the bus 224 and reads the ID from the bus 218. Next, the controiler f 92 
drives WRITE/READ FIFO signal on the line 20Bi to a write level and drives the 
received data and the !D onto the bus 212. Because the ID is the ID from the FIFO 
194i, the FIFO 194i recognizes the ID and thus loads the data fram the bus 212 in 
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response the write level of the WRITE/READ FIFO signaf. The remaining FIFOs 
i942 - iQ4n do not bad the data because the \D on the bus 212 does not 
CDiTespond to their IDs. Then, the pipeSine 74f asserts the READ/WRiTE FIFO 
signal on the line 2&2i to the read level and retrieves the reed data via the bus 21 4i. 
5 Also during the first shift cycte, the address and ID from the register 1962 are shifted 
into the register 196i, the address and iD from the register 196$ (not shown) are 
shifted into the register 1902^ and so on. Atternatively, the controlier 192 may 
recognke the ID and drive only the WRITE/READ FIFO stgna) on the iine 208^ to the 
write level This eliminates the need for the controlier 192 to send the ID to the 
10 FiFOs 194i-194n^ In another altennatjve, the WRITE/READ FIFO signal may be only 
a read signal, and the FIFO 194i (as well as the other FIFOs 194r194n) may load 
the data on the bus 212 when the ID on the bus 212 matches the ID of the FIFO 
194i. This eliminates the need of the controifer f 92 to generate a write slgnai, 

[152] During a second shift cycle, the address and ID from the register 196i 

15 IS shifted onto the busses 216 and 218 such that the controller 192 reads data from 
the focation of the DPSRAM 100 specified by the FiFO 1942^ Next, the controller 
f 52 drives the WRITE/READ FIFO signal to a write level and drives the received 
data and the ID onto the bus 212. Because the ID is the !D from the FIFO 1942, the 
FIFO 1942 recognizes the ID and thus loads the data from the bus 212. The 
20 remaining FIFOs 194i and 194^ - 194n do not load the data because the ID on the 
bus 2f 2 does not correspond to their IDs, Then, the pipeline 742 asserts its 
READAA/^RITE FIFO signal to the read level and retrieves the read data via the bus 
2142^ Also during the second shfft cyde, the address and ID from the register 1962 
is shifted into the register f 96^ . the address and ID from the register f 863 (not 
25 shown) is shifted into the register I962, and so on. 

[153] This continues for n shift cycles, /.a., untif the address and ID from the 

register 196^ (which is the address and iD from the FiFO 194n) are respectiveiy 
shifted onto the bus 216 and 218, The controller 192 may implement these shift 
cycles by pulsing the SHIFT/LOAD signal, or by generating a shift dock signal (not 
30 shown) that is coupled to the registers 19$i-19$f^. Furthemiore, if one of the 
registers 196f-1962 is empty during a particular shift operation because its 
corresponding FIFO 194i'194^ is empty, then the controller 192 may bypass the 
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empty register, and thus shorten the shift operation by avoiding shifting a null 
address onto the bus 210. 

[154] Referring to FIGS, 5 and 6, according to an embodiment of the 

invention, the interface 144 is similar to the interface 140, and the interface 136 is 
also similar to the interface 140 except that the interface i36 includes only one read 
channel 190, and thus includes no iD circuitry. 

|1 55J Pig. 8 is a schematic block diagram of a pipeline unit 230 of FIG. 4 

according to another embodiment of the invention. The pipeline unit 230 is similar to 
the pipeline unit 78 of FIG- 4 except that the pipeline unit 230 indudes muttipie 
pipeline circuits SO ~ here tNo pipeline circuits $0a and SOb. Increasing the number 
of pipeline circuits 00 typically ailows an increase in the number n of hardwired 
pipelines 74i-74m and thus an increase in the fynctionafity of the pipeline unit 230 
as compared to the pipeline unit 78. 

[1563 in the pipeiine unit 230 of FIG* 8, the services components, /.e., the 

communication interface 82, the controlfer 80, the exception manager 88, the 
configuration manager 90, and the optional industry^standard bus interface 91, are 
disposed on the pipeline circuit 80a, and the pipelines 74i-74n and the 
communicatton shelf 84 are disposed on the pipeime circuit 80b. By locating the 
services components and the plpefinas 74i-74n on separate pipeJine circuits, one 
can include a higher number n of pipelines and/or more compiex pipelines than he 
can where the service components and the pipelines are iocatad on the same 
pipeime circuit. Alternatively, the portion of the communication shell B4 that 
interfaces the pipelines 74i-74n to the interface B2 and the controller 86 may be 
disposed on the pipeiina circuit BOa. 

|157| FIG, 9 is a schematic block diagram of the pipeline circuits 80a end 

BOb and the data memory 92 of the pipeline unit 230 of FIG. 8 according to an 
embodiment of the invention. Other than the pipeline components being disposed 
on two pipelines cin::uits, the structure and operation of the pipeline circuits 80a and 
80b and the memory 92 of FIG. 9 are the same as for the pipeiine circuit 80 and 
memory 92 of FIG. 5. 
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[158] The preceding discussion is presented to enable a person skilted in the 

art to make and use the Invention, Various modifications to the embodiroents will be 
readily apparent to those skiiled in the art, and the generic prindples herein may be 
applied to other embodiments and appfications without departing from the spirit and 
6 scope of the present invention. Thus, the present invention is not Intended to be 

limited to the embodiments shown, but Is to be accorded the widest scope consistent 
with the principles and features discfosed herein. 
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WHAT IS CLAIMED iS: 

1 • A pipeline accaJerator, comprising: 
a memory; and 

a hardwired-pipelJne cincuit coupied to the memory and operable to, 
5 receive data, 

load the data into the memory, 

retrieve the data from the memory, 

process the retrieved data, and 

provide the processed data to an externai source, 

2. The pipefine accelerator of claim 1 wherein: 
the memory is disposed on a first integrated circuit; and 
the pipeline circuit is disposed on a second integrated drcuit 

3* The pipeline accelerator of ciaim 1 wherein the pipeline drcuit is 
disposed on a field-programmable gate array. 

4. The pipeline accelerator of claim 1 wherein the pipeline circuit is 
operable to provide the processed data to the external source by: 

loading the processed data into the memory; 
retrieving the processed data from the memory; and 
providing the retrieved pnDcessed data to the external source. 

5. The pipeline accelerator of claim 1 wherein: 
the external source comprises a processor; and 

the pipeline circuit Is operable to receive the data from the processor. 

6. A computing machine, comprising: 
a processor; and 

a pipeline accelerator coupled to the processor and comprising, 
a memory, and 

a hardwired-pipeline drcuit coupied to ttie memory and operable to, 
receive data from the processor, 
load the data into the memory, 
retrieve the data from the memory, 
process the retrieved data, and 
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provide the processed data to the processor. 

7. A pipeline accelerator, comprising: 
a memory; and 

a hardwired-pipelJne drcyft coupled to the memory and operable to, 
receive data, 

process the received data, 

load the processed data into the memory, 

retrieve the processed data from the memory, and 

provide the retrieved processed data to an external source. 

8. A computing machine, comprising: 
a processor; and 

a pipaiine accelerator coypied to the processor and comprising, 
a memory, and 

a hardwired-pipeline drcuit coupled to the memor>^ and operable to, 
receive data from the processor, 
process the received data, 
ioad the processed data into the memory, 
retrieve the processed data from the memory, and 
provide the retrieved processed data to the processor 

9. A pipeline accelerator, comprising: 
first and second memories: and 

a hardwired-pipelsne circuit coupled to the first and second memories and 
comprising, 

an input-data handier operabfe to receive rav^ data from an externa! 
source and to load tiie raw data into the first memory. 

a hardwired pipelme operabie to process the raw data, 

a pipeline Interface operable to retrieve the raw data from the first 
memory, provide the retrieved rav^ data to the hardwired pipeline, and ioad 
processed data from the hardwired pipeline into the second memory, and 

an output-data handler operable to retrieve the processed data from 
the second memory and to provide the processed data to the externa! source. 

1 0. The pipeline accelerator of claim 9 wherein: 
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the first and second memories each include respective first and second ports; 
the input-data handler is operable to load the raw data via the first port of the 
first memory, 

the pipeline interface is operable to retrieve the raw data via the second port 
of the first memory and to load the processed data via the first port of the second 
memory, and 

the output-data handler is operable to retrieve the processed data via the 
second port of the second memory* 

1 1 . The pipeline accelerator of claim 9, further comprising: 
a third memory coupled to the hardwired-pipeline circuit; 

wherein the hardwired pipeline is operable to generate intermediate data 
while processing the raw data; and 

wherein the pipaifne interface m operable to load the intemiediate data into 
the third memojy and to retrieve the mtermediate data from the third memory, 

12. The pipeiine accelerator of claim 8 wherein: 

the first and second memories are respectivety disposed on first and second 
integrated circuits; and 

the pipeMne circuit is disposed on a field-programmable gate array, 

1 3. The pipeline accelerator of claim 9, further comprising: 

an input-data queue coupled to the input-data handier and the pipeline 
interface; 

wherein the input-data handler is operable to load Into the input^Jata queue a 
pointer to a location of the raw data within the first memory: and 

wherein the pipeline interface is operabfe to retrieve the raw data from the 
location using the pointer. 

14. The pipeline acceterator of claim 9» further comprising: 

an output-data queue coupled to the outputniata handler and the pipeline 
interface; 

wherein the pipeline interface is operable to load into the output-data queue a 
pointer to a location of the processed data within the second memory; and 

wherein the output-data handier is operable to retrieve the processed data 
from the location using the pointer, 
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1 5. The pipeHne accelerator of c!aim 9, further comprising: 

wherein eaohof tha input-data handier, hardwired pipeyna, pipeline interface, 
and output-data handler has a respective operating configuration; and 

a configuration manager coupted to and opera bfe to set the operating 
configurations of the Input-data handler, hardwired pipeline, pipeline interface, and 
output-data handter 

16. The pipeline accelerator of ciajm 9, further comprismg: 

wherein each of the input-data handler, hardwired ptpeiine, pipeline interface, 
and output-^data handler has a respective operating status; and 

an exception manager coupled to and operable to identify an exception in the 
input-data handler, hardwired pipeline, pipeline Interface, or output-data handler in 
response to the operating statuses. 

17. A pipeline BGceterator, comprising: 

a hardwired pipeline operable to process data; and 
an input-data handler coupled to the hardwired pipeline and operabfe to, 
receive the data, 

detemriine whether the data is directed to the hardwired pipeline, and 
provide the data to the hardwired pipeline if the data Is directed to the 
hardwired pipeline, 

1 8. The pipeline acceterator of claim 1 7 wherein the input-data handler Is 
further operable to: 

receive the data by, 

receiving a message that Indudes a header and the data, and 
extracting the data from the message; and 
determine whether the data is directed to the hardwired pipeline by analyzing 
the header. 

1 9. The pipeiine accelerator of claim 1 7 wherein the hardwired pipeline 
and the input-data handler are disposed on a single field-programmable gate array. 

20. The pipeline accelerator of claim 17 wherein the hardwired pipeiine 
and the input^data handler are disposed on respective fiefd-programmabie gate 
arrays. 
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2 1 . A computing mach ine, com prisi ng: 
a processor; and 

a pjpelme accelerator coupled to the processor and comprising, 
a hard wi rod pipeline operable to process data, and 
an input-data handier coupled to the hardwired pipeline and operable 

to, 

receive the data from the processor, 

determine whether the data ts directed to the hardwired pipeline, 

and 

provide the data to the hardwired pipeline If the data Is directed 
to the hardwired pipeline, 

22. A pipeline acceterator, comprising: 

a hardwired pipelfna operable to generate data; and 
an output-data handler coypled to the hardwired pipeline and operable to, 
receive the data, 

detamilne a destination of the data, and 
provide the data to the destinatton, 

23. The pipeline accelerator of daim 22 wherein the output-data handier is 
further operable to: 

determine the destination of the data by. 
Identifying a type of the data, and 

determining the destination based on the type of the data; and 
provide the data to the destination by, 

generating a message that rdentifies the destination and that includes 

the data, and 

providing the message to the destination. 

24* A computing machine^ comprising: 
a processor operable to execute threads of an appHoatlon; and 
a pipeiine accelerator coupled to the processor and comprising: 
a hardv/ired pipeline operable to generate data, and 
an output-data handler coupled to the hardwired pipeline and operable 

to, 
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receive the data, 

identHy a thread of the application that subscribes to the data, 

and 

provide the data to the subscribing thread* 

25, A pipeline accelerator, comprising: 

a hardwired pipeline operable to process data values; and 
a sequence manager coupled to and operable to control the operation of the 
handwired pipeline. 

26. The pipeline accelerator of claim 25 wherein the sequence manager is 
operabie to control an order in which the hardwired pipeline receives the data 
values. 

27, The pipeline accelerator of daim 25 wherein the sequence manager is 
further operable to: 

receive an event; and 

control the hardwired pipeline in response to the event 

28, The pipeline accelerator of claim 25 wherein the sequenca manager !s 
further Dperable to: 

receive a synchronization signat; and 

control the operation of the hardwired pipeline In response to the 
synchronization signal. 

29. The pipeHne accelerator of claim 25 wherein the sequence manager is 
further operable to; 

sense an occutrence relative to the hardwired pipeline; and 
generate an event In response to the occurrence. 

30. A compyting machine, comprising: 

a processor operable to generate data and an event; and 

a pipeline aoceferator coupled to the processor and comprising, 

a hardwired pipeline operable to receive the data from the processor 
and process the reooived data; and 
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a seqyence manager coupled to the hardwired pipeline and operable 
to receive the event from the pnocessor and to control the operation of the hardwired 
pSpeiine in response to the event. 

31 . A pipeline acceferator, comprising: 

a hardwired-pipeline circuit having an operating configuration and operable to 
process data; and 

a configyratton manager coupled to the hafdwired-pipetine circuft and 
operable to set the operatmg configuration. 

32. The pipeline accelerator of claim 31 wherein: 

the hardwired^pipeline circuit includes a configuration register; and 
the configuration manager is operable to set the operating configy ration by 
loading a configuration valye into the configuration register. 

33, The pipeline accelerator of claim 32 wherein the configuration manager 
is operable to receive the configuration value from an external source. 

34, A computing machine, oomprising: 

a processor operable to generate data and a configuration value; and 
pipeiine acceierator coupled to the processor and comprising, 

a hardwired-pipeline circuit having an operating configuration and 
operabfe to process the data, and 

a configuration maoeger coupled to the hardwred-pipeifne circuit and 
operable to set the operating configuration in response to the configuration value. 

35. A pipeline accelerator, comprising: 

a hardwired-pipeline circuit having an operating status and operable to 
process data; and 

an exception manager coupied to the hardwired-pipeline circuit and operable 
to identilV an excepilon in the operation stafeis of the hardwtred-pipeline circuit in 
response to the operating status. 

36, The pipeline accelerator of claim 36 wherein: 

the hardwired-pipeline circuit is operable to generate a status value that 
represents the operating status; and 
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the exception manager is operable to identify the exception in response to the 
status vaSue. 

37. The pipeline accelerator of ciaim 36 wherein: 

the hartJwIred-pipeilne circuit includes a status register that Is operable to 
store the status value; and 

the exception manager receives the status value from the status register 

38. The pipeiiiie accelerator of oiaim 35 wherein the exception manager is 
operabie to identify an exceptionin the operating status of the hardwired-pipefine 
cfrcuit to an externa! source- 

39. A computing machine, comprising: 

a processor operabte to generate data; and 

a pipeline accelerator, comprising, 

a hardwired-pipeline circuit having an operating status and operable to 
process data and to generate a status value that represents the operating status, 
and 

an exception manager coupted to the hardwired-pipeline circuit and 
operabie to identify an exception in the operating status of the hardwired-pipeiine 
circuit in response to the status value and to notify the processor of the exception. 

40. A computing machine, comprising: 
a pipeline accelerator, comprising, 

a hardwired-pipeline circuit having an operating status and operable to 
process data, and 

an exception manager coupled to the hardwired-pipeline circuit and 
operabie to generate a status value that represents Hie operating status; and 

a processor coupled to the pipeline accelerator and operable to generate the 
data, to receive the status value, and to determine \A^ether the hardwired-pipeline 
circuit is malfunctioning by analyzing the status value. 

41 . A method, comprising: 
loading data into a memory; 
retrieving the data from the memory; 

processing the retrieved data with a hardwifBd-pipeiine circuit; and 
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providing the processed data to an external source. 

42. The method of datm 41 wherein providing the processed data 
comprises: 

loading the processed data into the memory; 
ret-ieving the processed data from the memory; and 
providing the retrieved processed data to the external source. 

43. A method , comp rising : 

pmcessing data with a hardwired-plpeiine circuit; 
toading the processed data into a memory; 
retrieving the processed data from the memoiy; and 
providing the retrieved processed data to an externa! source* 

44. A method, comprising: 

loading raw data from an externa! source into a first memory; 
retrieving the raw data from the first memory; 
processing the retrieved data with a hardwired pipeline; 
loading the processed data from the hardvi/ired pipeline into a second 
memory; and 

providing the processed data from the second memory to the external source, 

45. The method of cfaim 44 wherein: 

loading the raw data comprises ioeding the raw data via a first port of the first 
memory; 

retrieving the raw data comprises retrieving the raw data via a second port of 
the first memory; 

loading the processed data comprises loading the processed data via a first 
port of the second memory; and 

providing the processed data comprises retrieving the processed data via a 
second port of the second memory, 

46. The method of clarm 44, further comprising: 

generating intermediate data with the hardwred pipeline in response to 
processing the raw data; 

loading the intermediate data into a third memory; and 
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providing the intemiadiate data from tlie third memoiy back to the hardwired 

pipeline. 

47, The method of claim 44, further comprfsing: 

loading into an inpyt>message queue a pointer to a location of the raw data 
Within the first memory; and 

wherein retdeving the raw data comprises retrieving the raw data from the 
location using the pointer, 

48, The method of ciaim 44, further oomprising: 

Eoading into an output-message queue a pointer to a location of the processed 
data within the second memory; and 

wherein retrieving the processed data comprises retrieving the processed 
data from the location using the pointer 

49* The method of claim 44, further comprising setting parameters for 
loading and retrieving the raw data, processing the retrieved data, and loading and 
providing the processed data. 

50. The method of claim 44, further comprising determining whether an 
error occurs during the loading and retrieving of the raw data, the processing of the 
retrieved data, and the loading and providing of the processed data, 

51 • A method, comprising: 
receiving data; 

determining v/hetherthe data is directed to a hardwired pipeline; and 
providing the data to the hardwired pipeline If the data is directed to the 
hardwired pipeline. 

52. The method of ciaim 51 wherein: 
receiving the data comprises, 

receiving a message that includes a header and the data, end 
extracting the data from the message; and 
determining whether the data is directed to the hardwired pipeitne comprises 
analyzing the header. 

53. A method, comprising: 
generating data with a hardwired pipeline; 
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determining a destination of the data; and 
providing the data to the destination. 

54, The method of ciaim 53 wherein: 
determining the destination of the data comprises, 

identifying a type of the data, and 

determining the destination based on the type of the data; and 
providing the data to the destination comprises, 

generating a message that identifies the destination and that tndudes 
the data, and 

providing the message to the destination, 

55. A method, comprising: 

processing data values with a hardwired pipeline; and 
sequencing the operation of the hardwired pipeline. 

56. The method of cfalm 55 wherein sequencing the operation comprises 
sequencing an onjer in which the hardwired pipeline processes the data values. 

57, The method of claim 55 wherein sequencing the operating comprises 
synchronizrng the operation of the hardwired pipeline to a synchronization signal. 

58, The method of claim 55, further comprising: 

sensing a predefined occurrence during openation of the hardwired pipeline; 

and 

generating an event in response to the occurrence. 

59. A method, comprising: 

loading a configuration value into a register; and 
setting an operating configuration of a hardwired pipeline with the 
configuration value. 

60. A method, comprising: 

processing data with a hardwired pipefine; and 

identifying an error In the processed data by analyzing an operating status of 
the hardwired pipeline, 

61 , A method for designing a hardwired-pipeline circuit, comprising: 
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retrieving from a library a first data representatloo of a communication 

interface; 

generating a second data representation of a hardwired pipeline that is to be 
Goupted to the communicatiDn interface; and 

combining the first and second data representations to generate 
hard-configuration data for the hardwired-pipe!ine circuit. 

62, The method of cfaim 61 , further comprising modifying the first data 
representation by selecting values for predetermined parameters of the services 
layer before combining the first and second data representations. 

63, The method of claim 61 wherein the Gommunicatlon interface is 
operabte to allow the hardwired-pipeline circuit to communicate with another circuit, 

64, The method of claim 61 wherein combining the first and second data 
representations comprises compiling the first and second data representations into 
the hard-configuration data- 

66, The method of ciafm 61 wherein the hard-configuration data comprises 
firmware. 
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